Stationary Markov processes with continuous paths
نویسندگان
چکیده
منابع مشابه
Stationary Markov Processes
We consider some classes of stationary, counting{measure{valued Markov processes and their companions under time{reversal. Examples arise in the L evy{It^ o decomposition of stable Ornstein{Uhlenbeck processes, the large{time asymptotics of the standard additive coalescent, and extreme value theory. These processes share the common feature that points in the support of the evolving counting{ me...
متن کاملMarkov processes with product-form stationary distribution
This research has been inspired by several papers on processes with inert drift [5, 6, 4, 3, 1]. The model involves a “particle” X and an “inert drift” L, neither of which is a Markov process by itself, but the vector process (X, L) is Markov. It turns out that for a number of diffusions with inert drift, the stationary measure has the product form; see [1]. The purpose of this note is to chara...
متن کاملMarkov Decision Processes with Continuous Side Information
We consider a reinforcement learning (RL) setting in which the agent interacts with a sequence of episodic MDPs. At the start of each episode the agent has access to some side-information or context that determines the dynamics of the MDP for that episode. Our setting is motivated by applications in healthcare where baseline measurements of a patient at the start of a treatment episode form the...
متن کاملBounding Stationary Expectations of Markov Processes
This paper develops a simple and systematic approach for obtaining bounds on stationary expectations of Markov processes. Given a function f which one is interested in evaluating, the main idea is to find a function g that satisfies a certain “mean drift” inequality with respect to f , which in turn leads to bounds on the stationary expectation of the latter. The approach developed in the paper...
متن کاملContinuous time Markov decision processes
In this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission con...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Transactions of the American Mathematical Society
سال: 1956
ISSN: 0002-9947
DOI: 10.1090/s0002-9947-1956-0102857-9